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Description 

BACKGROUND OF THE INVENTION 

5 FIELD OF THE INVENTION 

[0001] The present invention relates generally to a moving image anchoring apparatus and a hypermedia apparatus 
employing this apparatus, and more particularly to an apparatus for inputting a moving image and setting an anchor 
to targets and suchlike included in said moving image and to a moving image hypermedia apparatus for linking related 
10 information to an anchor set by this apparatus and executing functions such as intended retrieval. 

DESCRIPTION OF THE PRIOR ART 

[0002] Generally in previous hypermedia apparatus the retrieval of information has taken the form whereby a logic 
15 unit for linking is created mainly for text or stationary images, the related information is linked to this logic unit, and 
when the user has clicked this logical unit, the related information is displayed. However, as for example is represented 
by MPEG relating to the coding and decoding of moving images, in recent years various techniques have been proposed 
for processing not only stationary images but also moving images. By handling moving images, the range of contents 
which can be created in the above hypermedia apparatus such as CAI, many types of presentation and electronic 
20 catalogs is expanded. 

[0003] Hitherto the use of editing of moving images has been somewhat limited to the industrial field such as broad- 
casting stations, but in the future it is expected rapidly to become widely available as a system for private use based 
on personal computers. 

[0004] Japanese Patent Application No. Hei 4-1 63589 discloses an image processing apparatus capable of setting 

25 logical units (therein referred to as "nodes") for moving images. In respect of the problem that setting of nodes for a 
stationary image is possible only with a specified display range, for a moving image this apparatus concentrates on 
(1 ) display range and (2) time, specifying the valid continuity period of the nodes and regional range and is an apparatus 
in which such specification is possible. Thus for (1 ) by pointing out with a mouse etc. the regions surrounding a subject 
appearing in a moving image the node at that time is set; on the other hand for (2) the valid continuity period of the 

30 node is specified according to the time elapsed since the start of the output of the moving image. Therefore this node 
is determined uniquely according to the region and the time elapsed, and a link can be made for the related information 
to each node. After a link is made, when the moving image is actually played, if the user clicks a region on the screen 
with a mouse etc., a node is pinpointed according to the position and time and the related information is displayed. 
[0005] In INFORMATION AND SOFTWARE TECHNOLOGY, vol. 36, no. 4, 1 January 1994, pages 213-223, 

35 XP000572844 Burrill V et al: Time-Varying Sensitive Regions in Dynamic Multimedia Objects: A Pragmatic Approach 
to Content Based Retrieval from Video' and N. Mandrane, M. Goldberg: "Towards Automatic Annotation of Video Doc- 
uments", pages: 773-776, 1 EEE 1 994, XP1 021 61 30 content-based retrieval systems from video are disclosed, wherein 
start frame and end frames are set. In these frames anchors are set and for the frames between the start frame and 
end frame anchors are interpolated. 

40 [0006] EP-A-0 596 823 discloses a method for selectively associating stored data with an animated element. The 
existence of the data set in a multimedia presentation and its association with the animated element is indicated for 
selection by the user. 

[0007] S. Kim, Jay Juo: "A Stochastic Approach for Motion Vector Estimation in Video Cording", SPIE, vol. 2304, 
pages: 1 1 1 -1 22, XP801 7931 , discloses a stochastic approach for motion vector estimation, wherein the center and the 
45 size of the search window varies according to the motion vectors obtained for previous frames. Further, the search is 
improved by using a probability density function centered in the search window. 

SUMMARY OF THE INVENTION 

50 [0008] In the above apparatus the setting of regions of logical units was performed manually. However, a moving 
image differs from a stationary image in that there are of course many frames and the position and shape of the subject 
are constantly changing. In the NTSC system 30 frames are required for 1 second and so even a simple calculation 
shows that when processing a moving image for 1 second, 30 settings would be required per 1 logical unit. For example, 
when creating contents lasting 5 minutes, if 5 logical units are set for 1 frame, the number of settings would amount 

55 to 45,000. In consideration of these points it is the object of the present invention to provide an apparatus which allows 
laborsaving and simplification in the setting of logical units (called "anchors" in the present claim) and more particularly 
an apparatus for automatically calculating or setting anchor information which has hitherto needed to be carried out 
for each frame. 
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(1) The moving image anchor setting apparatus of the present invention is an apparatus to set an anchor to an 
inputted moving image, and includes a frame specification portion for specifying a start frame and an end frame 
of the anchor setting period from a plurality of frames which make up an inputted moving image, an anchor setting 
portion for setting an anchor relating to an anchor region when corresponding anchor regions in a specified start 

5 frame and end frame have been specified, and by treating the start frame and end frame as standard frames for 

estimating, an anchor estimating portion to estimate the anchor information for a non-standard frame existing 
between these frames, based on the information of the anchor set at these frames. 

Here, "frame" refers to a display unit of an image, a concept including a picture in MPEG or the like. "Anchor" 
refers to a logical process unit constituted by a given region on a screen. "Anchor information" refers to information 

10 which can be expressed numerically such as for instance the position or shape of an anchor region, and the color 

when an anchor region is visibly displayed. An anchor is uniquely determined according to anchor information or 
in some cases according to the anchor name. "Corresponding region" refers to an anchor region relating to an 
identical anchor. Ordinarily, since the setting targets of the anchor are moving at the start frame and the end frame, 
the anchor region should also move. Therefore, even for an single anchor information is specified in no less than 

15 2 frames. These are premises of the present aspect. 

In this aspect, the moving image to be processed is inputted. Since the moving image is comprised of a plurality 
of frames, from among these frames a start frame and an end frame for the period during which an anchor is to 
be set (hereinafter, "anchor setting period") are specified. In other words, the period from the start frame to the 
end frame is the valid existence period for that anchor. 

20 Next a corresponding region for the start frame and the end frame is specified and an anchor for this region 

is set. At this stage, anchor information such as the anchor position for the given frames existing between these 
frames (hereinafter referred to simply as "non-standard frames") is unknown. The start frame and the end frame 
are treated as standard frames, and the anchor information is estimated based on information of the anchor set 
at these frames. Hereinafter the start frame and the end frame are referred to together as the "two outer standard 

25 frames." 

According to a moving image anchor setting apparatus of the present invention anchors need only to be set 
at a start frame and an end frame and man-hours required for an anchor setting operation can be greatly reduced. 

(3) In this apparatus an anchor information editing portion is also included for adding revisions to estimated anchor 

30 information about the non-standard frames. At this time the anchor information portion promotes a non-standard 

frame of which the anchor information has been revised to the standard frame. Hereinafter this frame is referred 
to as a "middle standard frame." Once a frame has become a middle standard frame it is used to estimate anchor 
information for other frames. If another non-standard frame X now exists between start frame A and middle standard 
frame B, for instance, the interpolation in (2) is executed based on the position of X between A and B. Or if another 

35 non-standard frame X now exists between middle standard frame B and end frame C, for instance, the interpolation 

in (2) is executed based on the position of X between A and B. If a plurality of middle standard frames is generated, 
interpolation is executed in the same way between the adjacent standard frames. 

When anchor information has been revised, in a case in which this is to be automatically promoted to a standard 
frame, a more accurate estimation is now made possible. The user need not be concerned with the replacement 

40 of standard frames. 

(2) In (1 ), in one aspect of the present invention the anchor estimating portion estimates the anchor information 
for the non-standard frame by interpolating the information of the anchor set at the start frame and the information 
of the anchor set at the start frame and the information of the anchor set at the end frame. In the simplest case 
linear interpolation is acceptable, or depending on the content of the moving image, non-linear interpolation can 

45 be used. 

In this case, anchor information of a non-standard frame is estimated by interpolation of anchor information 
and so the necessary anchor information can be obtained with a simple calculation. 

In (2), in one aspect of the present invention the anchor estimating portion executes interpolation by the fol- 
lowing procedure. First, an amount of variation in the corresponding information between the anchor set at the 

50 start frame and the anchor set at the end frame is calculated, then the ratio of the time-lapse from the start frame 

to the non-standard frame, to the time-lapse from the non-standard frame to the end frame is calculated. After this, 
the amount of change is divided according to this ratio. "Corresponding information" refers to information such as 
the two coordinates of the left upper points of the anchor regions set at the start frame and the end frame, and the 
two color codes of the anchor regions set at the start frame and the end frame. 

55 in this case, anchor information is estimated according to an interior division calculation from the amount of 

change in corresponding information between anchors and so this calculation can be rendered considerably less 
troublesome. 

In cases (1) - (2), in one aspect of the present invention the anchor setting portion includes an automatic anchor 
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setting portion. This automatic anchor setting portion selects a given number of frames from the anchor setting 
period as new standard frames. There are no particular rules for selection, but for instance a standard frame may 
be chosen every 5 frames. After this, by tracing the position of the anchor using the movement of the outline of 
the target as a pointer, the anchor information for the standard frame is set automatically. 
5 In this case, the time needed for the user to revise the anchor information is reduced. 

(3) In cases (1) - (2), in one aspect of the present invention, instead of using the outline information the anchor 
information for the standard frames is set automatically by tracing a position of an anchor using the vector of the 
outline of the target as a pointer. 

10 In this case also, the time needed for the user to revise the anchor information is reduced. 

(4) In (3) in one aspect of the present invention the automatic anchor setting portion first deems all the sections 
of the anchor setting period which are partitioned or divided by the standard frames to be unit judgment periods. 
Then for each of the paths which are possible to be followed by the anchor within the anchor setting period, the 

15 level of agreement between the path and the anchor movement vector is judged at each unit judgment period. For 

instance, 

1. including both ends there are three standard frames D, E, F 

2. each of these standard frames is divided into n block regions 

20 3. considering a model in which each block moves to an identical block in a different frame or to a different 

block, all paths will be less than n 3 (those paths which are not n 3 have been restricted by the first position and 
final position of the anchor). 

Now for all paths the agreement level between the path line and the movement vector of blocks including the 
25 anchor is judged at the 2 unit judgment periods D-E, E-F, and the judgment results are combined for the entire 

anchor setting period D-F. Finally the path having the highest agreement level in the combined results is taken as 
the movement path for the anchor. 

In this case, the level of agreement between a movement vector and a supposed path is under consideration 
and so the influence of the difference accompanying the movement vector can be decreased. 

30 

(5) In case (4) in one aspect of the present invention the agreement level is a function for an angle formed by the 
path and the movement vector, and the function does not have an extremum, that is a maximum value or a minimum 
value, while the angle x changes from 0° to 180°, and the combining is executed by calculating the sum total of 
the values of the function determined for each of the unit judgment periods. 

35 Because the function does not have an extremum, when the angle changes from 0° to 1 80° the function values 

gradually increase or decrease. Now the agreement level is evaluated according to the simple addition of these 
values. An example of this function would be y = x, y = cos (x) . 

In this case, the level of agreement is expressed by a function of the angle formed by a supposed path and a 
movement vector and so numerical evaluation of the level of agreement is possible. 

40 

(6) In cases (3)-(5), in one aspect of the present invention for all the sections of the anchor setting period which 
are partitioned by the standard frames the anchor estimating portion executes interpolation calculation of the anchor 
information between the standard frames positioned at both ends of the section, and estimates the anchor infor- 
mation for non-standard frames included in the section. For instance, as the frames are referred to as frame 5, 

45 1 o ... when there is a standard frame every 5 frames, interpolation calculation is executed for frames 6 and 7 etc. 

In this case, anchor information at a non-standard frame is estimated and so anchor information for all frames 
can be obtained. 

(7) In another aspect of the present invention, in (3)-(6) the anchor setting portion includes a standard frame 
50 deletion portion, and when the anchor information for a certain standard frame is obtainable having the designated 

permissible deviation value of error from the interpolation calculation of the anchor information in other standard 
frames, this standard frame deletion portion demotes the relevant standard frame to a non-standard frame. This 
permissible value is determined according to such points as the content of the moving image and user specifica- 
tions. The anchor of the demoted frame is thereafter calculated from the anchor position information of other 
55 standard frames. 

In this case, an unnecessary standard frame is deleted and so the calculation and amount of memory required 
can be decreased. 

In one aspect of the present invention, in one of the moving image anchor setting apparatus the anchor setting 
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portion includes a text anchor setting portion, and this text anchor setting portion sets an anchor containing a text 
when a corresponding text has been specified in the start frame and in the end frame. "Corresponding text" refers 
to a text which must be included in an identical anchor. In this aspect for instance an anchor region is set so as to 
surround the text. 

5 In this case, the number of targets set with links is increased and re-editing is simple. 

(8) In another aspect of the present invention, one of the moving image setting apparatuses also includes a cursor 
replacement portion to replace the display state of the cursor when the cursor has entered a given anchor region. 

In this case, anchor specification by the user is simple. 
10 At this time, the cursor replacement portion can replace the cursor display state so as to accompany the display 

of the name of the anchor region into which the cursor has entered. For instance, design can be such that when 
the cursor has entered an anchor region "Person A" the cursor changes to a "Person A" display text. 

If the name of the anchor region into which the cursor has entered is displayed, a certain amount of related 
information can be known without needing to be clicked. 

15 

(9) The hypermedia apparatus of the present invention is equipped with one of the above moving image anchor 
setting apparatuses, an anchor information memory portion for storing anchor information which has been set by 
the anchor setting portion, a link setting portion for linking stored anchor information with given related data, and 
a link retrieval portion for retrieving from a given anchor related data linked to that anchor. 

20 

[0009] In this aspect, the anchor information set by the moving image anchor setting apparatus and the given related 
data acquire a relation through linkage. At this time, for instance by clicking the anchor displayed on the screen the 
related information can be retrieved. 

[0010] According to the hypermedia apparatus all characteristics of the moving image apparatus can be utilized. 
25 Wide improvements in the efficiency of operations performed by the user such as creation of contents become possible. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0011] 

30 

Fig. 1 is a block diagram of a system including a moving image hypermedia apparatus in a first embodiment. 
Fig. 2 is a flowchart showing an anchor setting and revision procedure according to the first embodiment. 
Fig. 3 is a diagram depicting a table of anchor information set in the first embodiment. 

Fig. 4 is a diagram depicting an interpolation calculation method for anchor information according to the first em- 
35 bodiment. 

Fig. 5 is a diagram depicting a table obtained by adding anchor information of a middle standard frame to Fig. 3. 
Fig. 6 is a diagram depicting a method of executing interpolation calculation based on the middle standard frame 
in the first embodiment and two end standard frames. 

Fig. 7 is a flowchart showing a link setting and retrieval procedure according to the first embodiment. 
40 Fig. 8 is a diagram depicting a link information table in the first embodiment. 

Fig. 9 shows an example of a Ul screen for anchor setting. 

Fig. 10 is a block diagram of an anchor setting portion of a moving image hypermedia apparatus in a second 
embodiment. 

Fig. 11 is a flowchart showing an acquisition procedure for a movement vector in the second embodiment. 
45 Fig. 1 2 shows an example of a movement vector V (0) - V (2) obtained when to = 0, t1 =3 in Fig. 11 . 

Fig. 13 is a diagram depicting one of the paths which the anchor might have followed. 

Fig. 14 is a diagram showing V (t) of Fig. 12 added to v (t) of Fig. 13. 

Fig. 15 is a diagram depicting the deletion of a standard frame in the second embodiment. 

Fig. 16 is a diagram depicting the deletion of a standard frame in the second embodiment. 
50 Fig. 1 7 is a diagram depicting the deletion of a standard frame in the second embodiment. 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 

[0012] A preferred exemplary embodiment of a moving image hypermedia apparatus of the present invention will 
55 now be described. A moving image anchor setting apparatus of the present invention is utilized in this apparatus. 
According to the present apparatus, for instance with a moving image of an aquarium water tank, CAI software can be 
simply and effectively created so that when a given fish swimming in the tank is clicked, such information as the name 
of the fish and a supplementary explanation can be displayed. Hereafter "user" mainly refers to a creator of such 
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contents but it is of course applicable to someone who individually edits a video tape filmed by himself. 
Embodiment 1 

5 [0013] In this embodiment an apparatus is described which, based on an anchor region specified at a start frame 
and end frame by a user, automatically works out anchor information such as the position, shape and color of an anchor 
region at another frame by interpolation calculation. 

[0014] The complete system which includes a moving image hypermedia apparatus of this embodiment comprises 
a personal computer (hereinafter PC) which controls anchor and link setting processing, and a video play-back appa- 

10 ratus providing a moving image to this PC. This PC has a built-in video capture-board to supplement and digitalize the 
image provided from the video play-back apparatus. The video play-back apparatus is capable of functions such as 
play-back from a specified frame or time in addition to the usual functions such as play-back, stop, fast-forward and 
pause. This type of video play-back apparatus is widely used by broadcasting stations and the like but of course it is 
not restricted to these. Control of the various functions of the video play-back apparatus is carried out with the aid of 

15 a user interface (hereinafter Ul) deployed on the PC, for instance "Play Button" is displayed on the screen. In this case, 
when the user clicks this button, the action is transmitted via a signal cable from the PC to the video play-back apparatus. 
The video play-back apparatus itself is not a requisite constituent of a moving image hypermedia apparatus but is 
included in the system described here. Fig. 1 is a block diagram of a system including a moving image hypermedia 
apparatus according to this embodiment. 

20 [0015] The present apparatus divides broadly into a data operation portion 1 for operating data relating to anchor 
information and link information, a data storage portion 2 for storing this data, a display portion 3 for displaying this 
data in a recognizable shape, a user operation portion 4 for carrying out receipt and management of user operations, 
a video play-back apparatus 5 on which is played a moving image inputted by a moving image input portion 6. 

25 (1) Data Operation Portion 1 

[0016] Instructions from the user to the data operation portion 1 are carried out by a Ul to be explained later. Thus 
the internal construction referred to hereinafter is a software module. 

[0017] The user inputs specification of a start frame and an end frame for a specified frame portion 1 0. The example 
30 of the start frame and end frame shows the first and lastframes of ascene showing afish tankfrom the above-mentioned 
film of an aquarium. If the scene were to move temporarily to a film of the entrance of the aquarium, thereafter since 
there would be no need to set an anchor for the fish the end frame would be specified before the movement of the scene. 
[001 8] An anchor setting portion 1 1 actually sets the anchor between the start frame and the end frame. For instance 
when an anchor is set for a fish, first at the start frame a rectangle enclosing the fish is displayed using a mouse and 
35 registered as an anchor region. At this time the moving image is in the stop mode. Next the moving image is continued 
as far as the end frame where the same fish is enclosed a second time and an anchor region is registered. Since the 
fish is moving and changing direction between the start frame and the end frame its position and shape usually change. 
As a result, the shape and position of the anchor region registered at the start frame and the shape and position of the 
anchor region registered at the end frame do not generally match. The anchor setting portion 1 1 therefore includes an 
40 anchor information editing portion 11 0 to be explained below for use when revising an anchor, and a text anchor editing 
portion 1 1 1 to set an anchor for text such as a character string. 

[0019] An anchor information interpolation portion 12 executes interpolation calculation based on the information of 
the anchors set at the start frame and the end frame, and estimates the size and position of an anchor at a given frame 
(a non-standard frame). This process will be explained in detail below. A hyperlink setting portion 13 executes setting 
45 of a hyperlink to an anchor that has been set and generates structured data relating to the setting in the form of a table. 
A hyperlink retrieval portion 14 executes retrieval of set link information. In the above examples the fish anchor and 
the text data and the like showing the name of the fish are connected by a hyperlink. 

(2) Data Storage Portion 2 

50 

[0020] The data storage portion 2 may be a database, any type of file apparatus or memory apparatus. This is a 
hardware part. 

[0021] A moving image storage portion 20 stores moving image data which has been captured at a moving image 
input portion and digitalized. An anchor information storage portion 21 and a link information storage portion 22 re- 
55 spectively store anchor information and link information. 
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(3) Display Portion 3 

[0022] A display control portion 30 includes a display system program which generally controls the display of all 
types of image such as moving images during editing or Ul, a display circuit such as a VGA controller and a driver for 
5 this. The display control portion 30 has a cursor replacement portion 300. The cursor replacement portion 300 replaces 
the display state of the cursor when the cursor has entered an anchor region. The output data of the display control 
portion 30 are allocated to a display apparatus such as a PC monitor and the intended display is executed. 

(4) User Operation Portion 4 

w 

[0023] The user operation portion 4 allows the input of commands from a user, and comprises a keyboard, mouse, 
or any type of pointing device hardware and a command dispatcher. Anchor setting, revision of an anchor region, 
linking and link retrieval are examples of commands. 

15 (5) Moving Image Input Portion 6 

[0024] The moving image input portion 6 is a piece of hardware equivalent to a video capture board, having an AD 
converter and a frame memory (not shown in the drawings) for digitalizing an inputted moving image. The data is then 
provided to the moving image data storage portion 20. 
20 [0025] First the procedure for setting anchors and links will be explained and then the Ul state for anchor setting will 
be explained. 

[1] Anchor Setting 

25 [0026] Fig. 2 is a flowchart showing the anchor setting and revision procedure according to the present embodiment 
and Fig. 3 is a diagram showing a table of information for a set anchor. As Fig. 2 shows, various kinds of initialization 
processing are first executed (S21) with respect to the hardware, and the moving image data stored in the moving 
image data storage portion 20 are incorporated (S22). The front frame of the incorporated moving image data is first 
displayed as a stationary image on a display apparatus 31 . 

30 [0027] Next anchor information which has already been set for this moving image data is incorporated from the 
anchor information storage portion 21 (S23). If anchor information exists, its anchor region is actually displayed on the 
screen (hereinafter the mode wherein an anchor region is displayed on the screen is referred to as the "anchor display 
mode" and the mode wherein an anchor is not displayed as the "anchor non-display mode"). 

[0028] Following this, the moving image data are advanced to the start frame of the time period in which a new 
35 anchor is to be set (S24), and when the desired frame appears, the "start frame" button on the screen is pressed and 
the start frame is registered. This is now in the waiting state for the setting of the anchor region at this frame, and when 
the user for instance encloses another fish by clicking the mouse, a rectangular region is set. When the rectangular 
region is fixed, the coordinates of the left upper points (x1 , y1 ) and right lower points (x2, y2) are obtained and recorded 
as anchor information together with the frame number (numbered consecutively from the front frame of the moving 
40 image) of the start frame (S25). 

[0029] After this, the moving image data are again advanced and stopped when the desired end frame appears (S26) 
and a rectangular region encircling the same fish is set. Here the setting of the anchor region at the end frame is 
completed (S27). In Fig. 3 "anchor 1 " is the anchor ID showing this fish. The frame numbers of the start frame and end 
frame (frames 1 and 100 respectively) and the coordinates information for the anchor region are here contained in 
45 table form. 

[0030] When the anchor information at the two outer standard frames has been determined in this way, the anchor 
information for a frame between them is obtained by interpolation calculation (S28). Fig. 4 is a diagram showing the 
interpolation calculation method of anchor information. Here, with 

anchor information A (tO) at start frame (time tO) 
50 anchor information A (t1 ) at end frame (time t1 ) 

anchor information A (t) at time t 

t1 - tO = At 

then 

55 

A(t) = {A(t1 ) - A(t0)}t/At + {A(t0)t1 - A(t1 )t0}/At (equation 1 ). 

The external shape of the anchor region at a given time is ascertained by substituting A with the x1 , y1 , x2, y2 values. 
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The general movement of the anchor region is ascertained by substituting the central coordinates of the anchor region. 
If A is substituted with a color number, a utilization method wherein the color of the anchor region changes becomes 
possible. In addition, by internal calculation using equation 1 in a similar way it is possible to interpolate information 
which can be expressed numerically. Anchor information for a non-standard frame obtained through interpolation may 
5 be added to "anchor 1" region automatically in Fig. 3 or equation 1 calculation for a frame may be carried out each 
time the display of a frame is prescribed by the user. 

[0031] When S28 is completed, the anchor information is actually displayed and the contents are confirmed. Now 
returning to the start frame the moving image data is played and the anchor region is displayed at each frame by a 
rectangle. This rectangular region moves continually in compliance with the calculation results. 

w [0032] In the case of "anchor 1 " an extremely good result is achieved when the fish moves with constant velocity in 
a straight line, but in a case where the fish changes direction midway, it is envisaged that at a midpoint frame the 
anchor region might become misaligned from the fish. In this embodiment in such a case the anchor information is 
revised. The user first advances the moving image data to a frame with large misalignment and stops the image here. 
Next, the user clicks the edge portion of the anchor region displayed on the screen and alters the shape or position of 

15 the region using the mouse. An anchor information interpolation portion 12 promotes a frame revised in this way to a 
middle standard frame and this anchor information is added to the table in Fig. 3. Fig. 5 shows the table obtained when 
the anchor information of the middle standard frame is added to Fig. 3. 

[0033] Fig. 6 is a diagram depicting the interpolation calculation method based on the two end standard frames and 
the middle standard frame. If the non-standard frame which is the estimate target exists between the start frame and 

20 the middle standard frame, interpolation calculation is executed between those frames, and if the non-standard frame 
exists between the middle standard frame and the end frame, interpolation calculation is executed between those 
frames (S28). Thereafter, following display in S29 and re-revision in S30 when satisfactory anchor information is ob- 
tained (Y of S31 ) and preserved (S32) the anchor setting process is ended. When an anchor of another frame is revised 
in S30, of course this frame also becomes a middle standard frame. When two or more anchors are set for a single 

25 frame at S25, while automatically replacing the anchor ID according to the setting order within the apparatus, the 
rectangles of these anchor regions may be displayed in differing colors. 
[0034] The above procedures produce the following results: 

1. In the most minimal case, the anchor setting is executed only at the two outer standard frames and setting 
30 operation for the many frames existing between these is not necessary. 

2. When a misalignment of the anchor position has during interpolation calculation developed, this misalignment 
can be confirmed. Therefore, since frames needing to be revised are easily identified and once a frame has been 
revised it is automatically promoted to a middle standard frame, the user need not worry about matters such as 
whether or not to use a standard frame. 

35 3. For instance even in a case in which a fish for which an anchor has been set swims in an arc, if revision is 

executed for just a few frames in addition to the two outer standard frames, it will be possible to obtain sufficiently 
good anchor information. 

[0035] The above is an outline of the moving image hypermedia apparatus in the present embodiment and in par- 
40 ticular of the moving image anchor setting apparatus. 

[2] Link Setting 

[0036] Description will now be given of link setting for an anchor that has been set. Fig. 7 is a flowchart showing the 
45 link setting and retrieval procedures according to the present embodiment and Fig. 8 is a diagram depicting a table of 
information for a link that has been set. 

[0037] Fig. 7 shows the procedure order when anchor setting and link setting are executed completely independently. 
As in Fig. 2 various kinds of initialization processing are first executed (S40) and the moving image data are incorpo- 
rated. Next as the anchor information which was set in [1] is incorporated from the anchor information storage portion 

50 21 (S42), link information that has already been set is incorporated from the link information storage portion 22. 

[0038] Next, while determining the anchor information of another frame by interpolation calculation based on the 
anchor information of the two outer standard frames and the middle standard frame (S44), the anchor information is 
continually displayed in synchrony with the play-back of the moving image. This is now in the waiting state for input 
from the user at the user operation portion 4. 

55 [0039] Here on a moving image or after pausing a moving image, if the user clicks an anchor region and presses 
the "Create / Replace Link" button, the creation of link information for that anchor is executed (S47). For instance, 
when a fish in an aquarium is clicked, the candidate information such as a text or an image to be linked to that fish 
appears on the screen, then the text or the like which the user has chosen is linked to the anchor of the fish (more 
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precisely, to the fish as an object included in the anchor). In a case where there are no candidates the user himself 
can input a character string and link this. Fig. 8 shows a state wherein information in text format "anchorl. txt" has 
been linked to an anchor "anchorl" and a bit-map image "anchor2. bmp" has been similarly linked to an anchor 
"anchor2". When the link information has been determined in this way, the contents of the link are preserved in the link 

5 information storage portion 22 and the state returns to waiting for user input. 

[0040] If in S46 the user presses the "link retrieval" button and specifies an anchor, the link information corresponding 
to that anchor is retrieved and displayed (S49). In Fig. 8 for instance, for the fish in anchor 1 the name and length and 
other characteristics of the fish are displayed by a character string and for the fish in anchor 2 information such as a 
photograph of the sea in which the fish actually lives is displayed. Since the link operation can be confirmed from this 

10 display the user can complete the creation of contents at this point. The contents can also be merchandized, for instance 
by preservation on a recording medium such as a CD-ROM. When shipped as merchandise, the anchor region is 
generally replaced with a non-displayed anchor non-display mode. 

[0041 ] The anchor and link settings have here been described as independent processes, but for instance by creating 
a "return to anchor setting" button to be displayed on the screen during link setting it becomes possible to change freely 
15 between the two processes and editing is made easier. 

[3] Ul for Anchor Setting 

[0042] Fig. 9 is a diagram showing an example of a Ul screen for anchor setting. In the diagram the moving image 

20 to be the object of the process is displayed in an image display region 50. The top row of black buttons 52 are the 
object buttons which give direct instructions to the video such as play-back and stop. Next to these are a rectangular 
button 54 to set an anchor region for a frame displayed in the image display region, and similarly a start frame speci- 
fication button 56 and an end frame specification button 58 for specifying a displayed frame as a start frame or an end 
frame. In the diagram an anchor 60 has been set for one of the fish. 

25 [0043] On the center right side of the screen is an anchor-related box group 62 to display the name, ID, start frame 
number and end frame number of the anchor to be set or revised. Below the image display region 50 is a scene-related 
box group 64 for displaying the number of the scene including the frame presently being displayed and the serial 
number of the frame within the scene. Below this is a box 66 for moving an image very slightly forward or backward 
when editing. The image moves forward when the button on the right end is pressed and backward when the button 

30 on the left end is pressed. The position of the frame presently being displayed within the scene is being displayed by 
a vertical line 70. Below this box is a box 68 to display the positions of the start frame and end frame within the scene. 
The positions of the start frame and end frame are displayed respectively by the double vertical lines 72 and 74, and 
between these the position of the middle standard frame is being displayed by a triangular symbol 76. 
[0044] In the same diagram, using the scene number as a pointer the user first advances the video tape as far as 

35 the front of the scene for which he wishes to set an anchor. In this case for instance in a film of an aquarium comprising 
a plurality of scenes, the film has proceeded to scene No. 5 showing a fish tank. Here the user presses the right end 
button of box 66 and advances the moving image by one frame at a time. When the first frame of the anchor which is 
to be set appears, the user presses the start frame specification button 56 and registers this frame. Now the double 
vertical line 72 displaying the position of the start frame appears at the corresponding place in box 66. Here the user 

40 presses the rectangular button 54 and in the image display region 50 clicks the left upper point and right upper point 
of the anchor region he intends to set with the mouse. This ends the anchor setting for the start frame. Thereafter the 
moving image is advanced and in the same way the end frame is registered and an anchor set. 
[0045] When it detects the completion of the setting at the two outer frames, the anchor information interpolation 
portion 12 of the present apparatus automatically substitutes the anchor information into equation 1 and begins cal- 

45 culation. Here when the user for instance returns to the start frame and advances the moving image one frame at a 
time, the anchor information interpolation portion 12 determines the time corresponding to the frame presently being 
displayed and displays an anchor region based on an estimated result corresponding to this time. If the anchor region 
displayed is misaligned, the user again presses the rectangular button 54 and executes revision of the region. After 
revision the triangular symbol 76 appears at the point corresponding to this frame. 

50 [0046] Since this Ul actually displays the anchor information above the moving image data, editing results can be 
confirmed at real time and revisions can be simply executed. 

[0047] The above is an outline of the present embodiment. The following refinements and alterations and the like 
are envisaged in regard to the present embodiment. 

55 (1 ) Text anchor setting 

[0048] Text anchor setting is executed by the text anchor editing portion 111 in Fig. 1 . First on the screen, text data 
is edited and superimposed on the moving image and an anchor is set. A single region from a played-back image is 
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not specified as in a normal anchor setting, but a created text is placed on the image and an anchor region is set 
enclosing this text as appropriate. Methods such as directly inserting annotation onto a video film for instance have 
hitherto been generally used, but in such cases subsequent deletion of the annotation when re-editing is awkward. 
The present embodiment resolves this difficulty. 
5 [0049] When a text anchor has been set, the anchor information is also stored in the anchor information table. How- 
ever, in the table shown in Fig. 3 "frame" changes to "text" and a text name is entered in the column. 
[0050] Linking of related information is also possible for a text anchor. For instance for the aquarium scene in Fig. 9 
a text "Fish of the South Seas" may be pasted, to which a text such as "There are many brightly colored fish in the 
South Seas...." can be linked. 

w 

(2) Replacement of Cursor Display State 

[0051] Replacement of the cursor display state is executed by the cursor replacement portion 300 in Fig. 1. This 
function is particularly useful for an anchor non-display mode for instance when the contents are to be used by the 
15 end users. In order to execute this function the cursor replacement portion 300 has a position acquisition program for 
acquiring the cursor position at any time, a judgment program forjudging whether an acquired position is included by 
one of the anchor regions, and a replacement portion to decide in what way the display state of the cursor is to be 
replaced when the cursor has entered an anchor region and to actually replace the shape or such feature of the cursor 
according to this decision. 

20 [0052] When replacing a cursor, there are cases in which it is not intended to change the replacement contents for 
each anchor and cases in which it is intended. In the former, there is for instance a method for replacing a cursor 
ordinarily shown as a + symbol with © or for increasing the cursor brightness without depending upon the anchor 
region into which the cursor has entered. This aspect is particularly beneficial in cases where the movement and shape 
of the target are changing rapidly and the changes of the anchor region are severe. 

25 [0053] In the latter case, it is envisaged that the anchor ID of the anchor region into which the cursor has entered is 
retrieved from the replacement program and is displayed in the cursor position instead of the cursor. For instance, 
when the cursor has entered the anchor region of a certain fish, the contents of the anchor target can be displayed 
with the cursor as a "shark" or suchlike. According to this mode the user can learn the name of a fish without even 
needing to click the fish. 

30 

(3) Clear Specification of Middle standard frames 

[0054] In the present embodiment the two outer frames were first determined, but a case requiring revision is con- 
ceivable such as a case in which the movement of a target is erratic. In such a case, from the outset frames other than 
35 the start frame and end frame also receive clear or intentional anchor region specification. For instance in the Ul in 
Fig. 9 in addition to the start frame specification button 56 and the end frame specification button 58 a middle standard 
frame button may be provided. Since this frame is used as a standard frame from the outset, interpolation calculation 
can be regarded as starting from the state shown in Fig. 6. 

40 (4) Non-rectangular Anchor Regions 

[0055] Anchor regions need not be limited to rectangles. For instance in the case of a circle or an ellipse a region 
may be specified according to the three coordinates of the major axis, the minor axis and the center. For a polygon 
the coordinates of each vertex may be used. When the perimeter itself of a target is to be the anchor region, the region 
45 can be specified according to a coordinate of one point above the perimeter and a chain code expressed from that point. 

(5) Adoption of Non-linear Interpolation 

[0056] In the present embodiment for maximum simplicity linear interpolation was used but of course non-linear 
50 interpolation is acceptable. The equation used for interpolation can be determined according to experiments tailored 
to the characteristics of the moving image to be processed. 

Embodiment 2 

55 [0057] In the first embodiment calculation of anchor information was executed automatically by interpolation and 
revision was executed manually. An apparatus which, based on an analysis of a moving image, automatically sets an 
anchor beforehand with a certain number of frames as standard frames and utilizes the interpolation method of the 
first embodiment between these standard frames will now be described. In this aspect, since a frame equivalent to the 
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middle standard frame of the first embodiment exists from the outset the manual labor required for revision is reduced. 
[Configuration] 

5 [0058] Fig. 10 is a block diagram of an anchor setting portion 11 of a moving image hypermedia apparatus in the 
present embodiment. Other than the anchor setting portion 1 1 the configuration is the same as shown in Fig. 1 . In Fig. 
1 0 an automatic anchor setting portion 1 1 2 has a moving vector utilization setting portion 1 1 3 and an outline information 
utilization setting portion 114. Hitherto only one of these 2 setting portions has been implemented but in the present 
embodiment both are implemented and either of the two can be chosen to suit the given circumstances. Furthermore, 

10 as will be explained below the standard frame deletion portion 1 1 5 returns to non-standard frames those frames among 
the frames set by the automatic anchor setting portion 112 which are redundant. 

[PROCESSING OPERATION] 

15 [1] Automatic Anchor Setting using Movement Vectors 

[0059] The feature of processing in this embodiment lies in a two level process for increasing the tracking precision 
of the anchor by first determining the movement vector of the anchor from the start frame to the end frame, and then 
in due course judging the agreement between the supposed movement path of the anchor and the movement vector. 

20 

1 . Obtaining a Movement Vector 

[0060] The times of the start frame and end frame are given as to and t1 respectively. In addition to these a number 
of non-standard frames are first replaced with standard frames. For simplicity let us suppose that every other five 
25 frames are replaced and hereafter let us normalize the time-lapse between standard frames as 1 . In order to determine 
the movement vector of a specific anchor in the period from the start frame to the end frame, block matching is executed 
with an image region near to the center of the anchor as a block. A frame corresponding to a given time t is here 
expressed as frame (t). 

[0061] Fig. 11 is a flowchart showing an acquisition procedure for a movement vector in the present embodiment. 

30 As in the diagram a time counter t is first advanced or in some cases returned to to (S1 00). Next the anchor for which 
the movement vector is to be obtained is specified from among the anchors set at the start frame. The movement 
vector utilization setting portion 1 1 3 stores the region including the center of the specified anchor as a block to be used 
when block matching (hereinafter referred to as an "anchor block") (S101). Next the image data I (t) of frame (t) and 
the image data I (t + 1 ) of frame (t + 1 ) are obtained (S1 02). I (t) is the collective data of the pixel values p for each of 

35 the pixels included in the frame. 

[0062] Following this the optimum matching is searched for while moving the anchor block within the frame (t + 1) 
(S103). Since all the pixel values for the anchor block itself are identified from I (t) the anchor block is placed at a given 
point in the frame (t + 1), the square deviation of the pixel values is calculated from the corresponding pixels and this 
is integrated within the entire anchor block region. This integration is executed while gradually moving the anchor block 

40 and the position where the integration value is lowest is judged to be the motion target (destination) of the anchor block. 
[0063] Once the motion target has been identified, since the motion quantity and motion direction from the anchor 
block at frame (t) to the anchor block at frame (t + 1 ) are confirmed, a movement vector V (t) is obtained (S1 04). Here 
it is judged whether or not t + 1 has reached the time t1 of the end frame (S105) and if it has not been reached t is 
incremented (S106) and the movement vector is repeatedly obtained. Once t + 1 is equivalent to t1 the V (t) hitherto 

45 obtained is preserved (S107) and processing ends. 

[0064] Fig. 12 shows an example of a movement vector V (0) - V (2) obtained when to = 0 and t1 = 3. As the diagram 
shows, V (t) can be expressed by the three components (x, y, t) according to x and y determined by the length and 
breadth on the screen and t determined by time direction. 

50 2. Judgment of Agreement Level 

[0065] Each frame is divided into blocks of similar size as the anchor blocks created when the movement vector is 
obtained and all paths which the anchor could have followed are picked out. Fig. 1 3 is a diagram depicting one of these 
paths. In this diagram, the frames are divided into 16 blocks and the starting point of the path at the start frame and 
55 the end point of the path at the end frame are in agreement with the anchor block shown in Fig. 11. Under these 
conditions, all paths will thus be 1 6 x 1 6. Next in each section of these possible paths (hereinafter "supposed paths") 
the vector v (t) shown in Fig. 13 (hereinafter "path vector") is defined. The path vector is determined by the direction 
when following a supposed path from one frame to the next frame, v (t) is also described with the 3 components (x, y, t). 
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[0066] The angle formed in each section by V (t) and v (t) is defined as 0t, and f (t) = cos9t is calculated according 
to the following equation using the inner product. 

5 f (t) = ( V(t), v(t) ) / 1 V(t) | ■ | v(t)| (Equation 2) 

[0067] Fig. 1 4 is a diagram depicting V (t) of Fig. 1 2 added to v (t) of Fig. 1 3, showing the meaning of 9t. When f (t) 
of equation 2 is great the level of agreement between the supposed path and the movement vector in that section is 
high, but even if the level of agreement in one section is at maximum, if the levels of agreement in the other sections 
10 are extremely low, the level of agreement for the whole must be regarded as low. Here while including the level of 
agreement at each section, the following evaluation equation is inserted in order to evaluate the level of agreement of 
the whole: 

15 g (t) = max {f (t-1 ) + g (t-1 )} (Equation 3) 

[0068] A supposed path having the highest level of agreement can usually be pinpointed by recurrently calculating 
equation 3. Since the supposed path having the highest level of agreement for the whole can be pinpointed if this 
calculation is executed right up to the end frame, this path is regarded as the motion path of the anchor. Thereafter 
20 the points at which this motion path intersects each standard frame are taken as those at which the anchor will exist 
and automatic anchor setting is executed. The set anchor information may be added to the anchor information table 
shown in Fig. 3. 

[0069] According to the present aspect, since judgment includes not only the movement vector which ordinarily 
accompanies a certain level of deviation but also the suitability of the path, tracking precision is improved. Therefore 
25 anchor information of a middle standard frame which has been set beforehand is accurate, and man-hours required 
for setting and revision the anchor are greatly reduced for the user. Furthermore, according to the method in the first 
embodiment, anchor information for frames other than standard frames may be successively determined from inter- 
polation calculation. 

30 [2] Automatic Anchor Setting based on Utilization of Outline Information 

[0070] As another method of automatic anchor setting an anchor can be tracked based on the motions of the outline 
of a target. At the outline information utilization portion 114 an outline image of each frame is generated by the same 
repetition process shown in Fig. 1 1 . An outline image is composed of pels that have either zero or one as their values. 
35 |f the pels on the outline are to have one as their values, other pels would have zero as their values. The outline image 
can be generated with a compass-gradient-type filter or such like. When the outline image is determined, anchor track- 
ing can thereafter be executed taking the anchor motion as identical to the motion of the target. 

[3] Deletion of Unnecessary Standard Frames 

40 

[0071] In the above example a standard frame was set every five frames. However, for instance when a target moves 
in a straight line at constant velocity, a start frame and end frame alone are sufficient. Even in a case in which a target 
is not moving in a straight line at constant velocity from the start frame to the end frame, for the period during which it 
does move in this way only two outer standard frames are needed. As the number of standard frames decreases, so 

45 the number of supposed paths also decreases and the calculation is consequently less laborious. 

[0072] In this respect the standard frame deletion portion 115 executes deletion of unnecessary standard frames. 
Figs. 1 5-1 7 are diagrams depicting the deletion of a standard frame in the second embodiment. The horizontal axis in 
these diagrams shows time, and the vertical axis shows the distance from the original points of the x-y coordinates set 
on the frame. In addition, the O symbol in these diagrams shows the anchor region in schematic form. Deletion is 

50 executed in the following order. 

[Fig. 15] 

[0073] At first six standard frames are set including the two outer frames. Here the anchor of the start frame and the 
55 anchor of the end frame are joined with astraight line and the distance of each anchor from this straight line is calculated. 
When there is an anchor with a distance less than the designated value, the standard frame having this anchor is 
deleted. The case shown in this diagram is one in which no anchors have been deleted. Next the anchor farthest from 
the straight line (hereinafter the farthest anchor) is found out. Here the anchor at t = 3 is the farthest anchor. 
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[Fig. 16] 

[0074] The straight line is erased and the anchor at the start frame, the farthest anchor, and the anchor at the end 
frame are joined by a polygonal line and the distances from the anchors to this line are once more determined. The 
anchor at t = 4 which had a distance less than the designated value is deleted. The anchor at t = 2 now becomes the 
farthest anchor. 

[Fig. 17] 

[0075] The regular line is revised so as to pass through the new farthest anchor. Here the anchor at t = 2 which had 
a distance from the new regular line which was less than the designated value is deleted. This ends the process. 
[0076] In this example two standard frames were deleted. When there are many standard frames at the beginning 
of the process, this sequence may be repeated: 1 . deletion of standard frame less than the designated value, 2. finding 
out the farthest anchor, 3. revision of regular line. 

[0077] The above is an outline of the present embodiment. The following refinements or modifications are envisaged 
for this embodiment. 

(1) Modification of Equation 2 

[0078] Equation 2 employed f (t) = cos 8t but of course other equations may be employed. Functions of which value 
increases when 6t increases can be applicable. 

(2) Block-taking 

[0079] In Fig. 1 2 an anchor block was determined so as to include the central vicinity of the anchor region, but other 
methods of determination are acceptable. For instance an anchor region can itself be designated as a block. Similarly 
in Fig. 1 3 a block can be determined without regard to the size of the anchor block. 



Claims 

1 . A moving image anchor setting apparatus for inputting a moving image and setting an anchor to the moving image, 
comprising: 

a frame specification portion (10) for specifying a start frame and an end frame from a plureality of frames 
which constitute the moving image in the anchor setting period during which an anchor is to be set; 
an anchor setting portion (11) for setting an anchor relating to an anchor region when corresponding anchor 
regions in a specified start frame and end frame have been specified; and 

an anchor estimating portion (1 2) for estimating by interpolation anchor information for the non-standard frames 
existing between the start frame and end frame based on anchor information set for the start frame and end 
frame after treating these frames as standard frames for estimation, 

an anchor information editing portion (110) for adding revisions to the anchor information estimated for the 
non-standard frames, 

characterized in that 

the anchor estimating portion (12) specifies a non-standard frame, having revised anchor information, as middle 
standard frame, and thereafter estimates anchor information at other frames by executing an interpolation between 
said middle standard frame and its adjacent standard frames. 

2. A moving image anchor setting apparatus according to claim 1 , characterized in that 

the anchor estimating portion (1 2) estimates anchor information in the non-standard frame by interpolating anchor 
information set for the start frame and anchor information set for the end frame. 

3. A moving image anchor setting apparatus according to claim 1 or 2, characterized in that 

the anchor setting portion (11) includes an automatic anchor setting portion (112), wherein this automatic anchor 
setting portion (112) chooses a given number of frames from an anchor setting period and renders them new 
standard frames, and thereafter automatically sets anchor information for the standard frames by tracing a position 
of an anchor using the movement vector of a target as a pointer. 
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4. A moving image anchor setting apparatus according to claim 3, characterized in that 

the automatic anchor setting portion (112) uses each section of the anchor setting period partitioned by the standard 
frames as a unit judgment period; and wherein 

in each unit judgment period, the level of agreement between an anchor movement vector and each of the paths 

reached by the anchor within the anchor setting period is judged; 

the judgment results spanning the entire anchor setting period are totalled, and 

from the total result the path having the highest level of agreement is taken as the motion path of the anchor. 

5. A moving image anchor setting apparatus according to claim 4, characterized in that 

the level of agreement is a function of an angle formed by the path and the movement vector, the function having 
no extremums while the angle changes from 0° to 180°; and 

the totalling is executed according to calculation of the sum of the function values determined for each of the unit 
judgment periods. 

6. A moving image anchor setting apparatus according to one of claims 3 to 5, characterized in that 

for each section of the anchor setting period partitioned by the standard frame, the anchor estimating portion (112) 
executes interpolation calculation of anchor information between frames positioned at both ends of the section 
and estimates the anchor information for a non-standard frame included in the section. 

7. A moving image anchor setting apparatus according to one of claims 3 to 6, characterized in that 
the anchor setting portion (11) includes a standard frame deletion portion (115); and 

when anchor information at a particular standard frame is acquired having a designated permissible deviation 
value from an interpolated calculation of anchor information in other standard frames, this standard frame deletion 
portion (115) denotes the relevant standard frame to a non-standard frame. 

8. A moving image anchor setting apparatus according to one of claims 1 to 7, characterized by 

a cursor replacement portion (300) for replacing the display state of a cursor when the cursor has entered a given 
anchor region. 

9. A moving image hypermedia apparatus comprising: 

a moving image anchor setting apparatus according to one of claims 1 to 8; 

an anchor information storage portion (21) for storing anchor information set by the anchor setting apparatus 
(11); 

a link setting portion (13) for linking stored anchor information and given related data; 
a link information storage portion (22) for storing set link information; and 

a link retrieval portion (1 4) for retrieving from a given anchor related data which has been linked to the anchor. 



Patentanspruche 

1. Ankersetzvorrichtung fur bewegte Bilder fur die Eingabe eines bewegten Bildes und das Setzen eines Ankers in 
dem bewegten Bild, welche aufweist: 

einen Vollbild-Spezifikationsbereich (10) zum Spezifizieren eines Anfangsvollbildes und eines Endvollbildes 
aus mehreren Vollbildern, die das bewegte Bild in der Ankersetzperiode, wahrend der ein Anker zu setzen ist, 
darstellen; 

einen Ankersetzbereich (11 ) zum Setzen eines Ankers in Bezug auf einen Ankerbereich, wenn entsprechende 
Ankerbereiche in jeweils einem spezifizierten Anfangsvollbild und Endvollbild spezifiziert wurden; und 
einen Ankerschatzbereich (12) zum Schatzen von Ankerinformationen durch Interpolation fur die zwischen 
dem Anfangsvollbild und dem Endvollbild bestehenden Nichtstandard-Vollbilder auf der Grundlage von fur 
das Anfangsvollbild und das Endvollbild gesetzten Ankerinformationen nach der Behandlung dieser Vollbilder 
als Standardvollbilder fur die Schatzung, 

einen Ankerinformations-Aufbereitungsbereich (11 0) fur das Hinzufugen von Revisionen zu den fur die Nicht- 
standard-Vollbilder geschatzten Ankerinformationen, 

dadurch gekennzeichnet, dass 

der Ankerschatzbereich (12) ein Nichtstandard-Vollbild, das revidierte Ankerinformationen hat, als mittleres Stan- 
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dardvollbild spezifiziert, und danach Ankerinformationen bei anderen Vollbildern durch Durchfuhren einer Interpo- 
lation zwischen dem mittleren Standardvollbild und seinen benachbarten Standardvollbildern schatzt. 

2. Ankersetzvorrichtung fur bewegte Bilder nach Anspruch 1 , dadurch gekennzeichnet, dass der Ankerschatzbe- 
5 reich (12) Ankerinformationen in dem Nichtstandard-Vollbild durch Interpolieren von Ankerinformationen, die fur 

das Anfangsvollbild gesetzt sind, und Ankerinformationen, die fur das Endvollbild gesetzt sind, schatzt. 

3. Ankersetzvorrichtung fur bewegte Bilder nach Anspruch 1 oder 2, dadurch gekennzeichnet, dass der Anker- 
setzbereich (11) einen automatischen Ankersetzbereich (112) enthalt, wobei dieser automatische Ankersetzbe- 

10 reich (112) eine gegebene Anzahl von Vollbildern aus einer Ankersetzperiode auswahlt und sie zu neuen Stan- 

dardvollbildern macht, und danach automatisch Ankerinformationen fur die Standardvollbilder setzt durch Verfol- 
gen einer Position eines Ankers unter Verwendung des Bewegungsvektors eines Ziels als einen Zeiger. 

4. Ankersetzvorrichtung fur bewegte Bilder nach Anspruch 3, dadurch gekennzeichnet, dass 

15 der automatische Ankersetzbereich (1 1 2) jeden Abschnitt der durch die Standardvollbilder geteilten Ankersetzpe- 

riode als eine Beurteilungseinheitsperiode verwendet; und wobei 

in jeder Beurteilungseinheitsperiode der Pegel der Ubereinstimmung zwischen einem Ankerbewegungsvektor und 
jedem der Pfade, die durch den Anker innerhalb der Ankersetzperiode erreicht werden, beurteilt wird; 
die die gesamte Ankersetzperiode uberspannenden Beurteilungsergebnisse summiert werden, und 
20 aus dem Gesamtergebnis der Pfad mit dem hochsten Ubereinstimmungspegel als der Bewegungspfad des Ankers 

genommen wird. 

5. Ankersetzvorrichtung fur bewegte Bilder nach Anspruch 4, dadurch gekennzeichnet, dass 

der Ubereinstimmungspegel eine Funktion eines durch den Pfad und den Bewegungsvektor gebildeten Winkels 
25 ist, wobei die Funktion keine Extreme hat, wahrend sich der Winkel von 0° bis 180° andert; und 

das Summieren durchgefuhrt wird gemaB der Berechnung der Summe der Funktionswerte, die fur jede der Beur- 
teilungseinheitsperioden bestimmt sind. 

6. Ankersetzvorrichtung fur bewegte Bilder nach einem der Anspruche 3 bis 5, dadurch gekennzeichnet, dass 
30 fur jeden Abschnitt der durch das Standardvollbild geteilten Ankersetzperiode der Ankerschatzbereich (1 1 2) eine 

Interpolationsberechnung fur Ankerinformationen zwischen Vollbildern, die an beiden Enden des Abschnitts po- 
sitioniert sind, durchfuhrt und die Ankerinformationen fur ein in dem Abschnitt enthaltenes Nichtstandard-Vollbild 
schatzt. 

35 7. Ankersetzvorrichtung fur bewegte Bilder nach einem der Anspruche 3 bis 6, dadurch gekennzeichnet, dass 
der Ankersetzbereich (11) einen Standardvollbild-Loschbereich (115) enthalt; und, 

wenn Ankerinformationen bei einem besonderen Standardvollbild erhalten werden, die einen bezeichneten er- 
laubten Abweichungswert von einer interpolierten Berechnung von Ankerinformationen in anderen Standardvoll- 
bildern haben, bezeichnet dieser Standardvollbild-Loschbereich (1 1 5) das relevante Standardvollbild als ein Nicht- 
40 standard-Vollbild bezeichnet. 

8. Ankersetzvorrichtung fur bewegte Bilder gemaB einem der Anspruche 1 bis 7, gekennzeichnet durch einen Cur- 
sorersetzbereich (300) zum Ersetzen des Anzeigezustands eines Cursors, wenn der Cursor in einen gegebenen 
Ankerbereich eingetreten ist. 

45 

9. Hypermedia-Vorrichtung fur bewegte Bilder, welche aufweist: 

eine Ankersetzvorrichtung fur bewegte Bilder nach einem der Anspruche 1 bis 8; 

einen Ankerinformations-Speicherbereich (21 ) zum Speichern von von der Ankersetzvorrichtung (1 1 ) gesetz- 
50 ten Ankerinformationen; 

einen Verbindungssetzbereich (13) zum Verbinden gespeicherter Ankerinformationen und gegebener bezo- 
gener Daten; 

einen Verbindungsinformations-Speicherbereich (22) zum Speichern gesetzter Verbindungsinformationen; 
und 

55 einen Verbindungsabrufbereich (14) zum Abrufen von ausgegebenen ankerbezogenen Daten, die mit dem 

Anker verbunden wurden. 
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Revendications 



1 . Appareil de placement d'ancre sur une image animee pour saisir une image animee et placer une ancre sur I'image 
animee, comprenant : 

5 

une partie de specification de trame (1 0) pour specifier une trame de depart et une trame de fin a partir d'une 
pluralite de trames qui constituent une image animee pendant la periode de placement d'ancre au cours de 
laquelle une ancre doit etre placee; 

une partie de placement d'ancre (11) pour le placement d'une ancre Nee a une region d'ancre lorsque des 
10 regions d'ancre correspondantes dans une trame de depart et une trame de fin specifiees ont ete specifiees ; 

et une partie d'estimation d'ancre (12) pour estimer, par interpolation, des informations d'ancre pour les trames 
non standard existant entre la trame de depart et la trame de fin sur la base d'informations d'ancre placee 
pour la trame de depart et la trame de fin apres le traitement de ces trames comme trames standard pour 
estimation, 

15 une partie d'edition d'informations d'ancre (11 0) pour ajouter des revisions aux informations d'ancre estimees 

pour les trames non standard, 

caracterise en ce que 

la partie d'estimation d'ancre (12) specifie une trame non standard, ayant des informations d'ancre revisees, 
20 comme trame standard centrale et, ensuite, estime des informations d'ancre sur d'autres trames en executant une 

interpolation entre ladite trame standard centrale et ses trames standard adjacentes. 

2. Appareil de placement d'ancre sur une image animee selon la revendication 1 , caracterise en ce que : 

25 la partie d'estimation d'ancre (12) estime des informations d'ancre dans la trame non standard en interpolant 

des informations d'ancre placee pour la trame de depart et des information d'ancre placee pour la trame de fin. 

3. Appareil de placement d'ancre sur une image animee selon la revendication 1 ou 2, caracterise en ce que la 
partie de placement d'ancre (11) comprend une partie de placement d'ancre automatique (1 1 2), dans lequel cette 

30 partie de placement d'ancre automatique (11 2) choisit un nombre donne de trames sur une periode de placement 

d'ancre et les transforme en nouvelles trames standard et, par la suite, place automatiquement des informations 
d'ancre pour les trames standard en suivant une position d'une ancre en utilisant le vecteur de mouvement d'une 
cible comme indicateur. 



35 4. Appareil de placement d'ancre sur une image animee selon la revendication 3, caracterise en ce que la partie 
de placement d'ancre automatique (112) utilise chaque section de la periode de placement d'ancre separee par 
les trames standard comme periode de jugement unitaire ; et dans lequel, dans chaque periode de jugement 
unitaire, le niveau d'agrement entre un vecteur de mouvement d'ancre et chacun des chemins atteints par I'ancre 
au cours de la periode de placement d'ancre est juge; les resultats du jugement couvrant toute la periode de 

40 placement d'ancre sont totalises, et on retire du resultat total le chemin ayant le niveau d'agrement le plus eleve 

que Ton considere comme le chemin de mouvement de I'ancre. 

5. Appareil de placement d'ancre sur une image animee selon la revendication 4, caracterise en ce que le niveau 
d'agrement est une fonction d'un angle forme par le chemin et le vecteur de mouvement, la fonction n'ayant pas 

45 de valeurs extremes, tandis que Tangle varie de 0° a 180° ; et le total est effectue en calculant la somme des 

valeurs de la fonction determinees pour chacune des periodes de jugement unitaire. 

6. Appareil de placement d'ancre sur une image animee selon I'une quelconque des revendications 3 a 5, 
caracterise en ce que : 

50 

pour chaque section de la periode de placement d'ancre separee par les trames standard, la partie d'estimation 
d'ancre (112) execute un calcul d'interpolation d'informations d'ancre entre les trames positionnees aux deux 
extremites de la section et estime les informations d'ancre pour une trame non standard indue dans la section. 

55 7. Appareil de placement d'ancre sur une image animee selon I'une quelconque des revendications 3 a 6, caracterise 
en ce que la partie de placement d'ancre (11) comprend une partie de suppression de trame standard (115); et, 
lorsque des informations d'ancre pour une trame standard particuliere sont acquises, qui ont une valeur d'ecart 
toleree designee a partir d'un calcul interpole d'informations d'ancre dans d'autres trames standard, cette partie 



16 



EP 0 788 063 B1 



de suppression de trame standard (115) retrograde la trame standard pertinente en une trame non standard. 

Appareil de placement d'ancre sur une image animee selon Tune quelconque des revendications 1 a 7, caracterise 
par une partie de remplacement de curseur (300) pour le remplacement de I'etat d'affichage d'un curseur lorsque 
le curseur est entre dans une region d'ancre donnee. 

Appareil hypermedia d'image animee comprenant 

un appareil de placement d'ancre sur une image animee selon I'une quelconque des revendications 1 a 8; 

une partie de mise en memoire d'informations d'ancre (21) pour la mise en memoire d'informations d'ancre 
placee par I'appareil de placement d'ancre (11) ; 

une partie de placement de lien (13) pour lier des informations d'ancre mise en memoire et des donnees 
apparentees donnees; 

une partie de mise en memoire d'informations de lien (22) pour la mise en memoire d'informations de lien 
place; et 

une partie d'extraction de lien (14) pour extraction de donnees apparentees d'une ancre donnee qui ont ete 
liees a I'ancre. 
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